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Abstract. In the recent paper [B02 , Borodin and Olshanski have presented 
a novel proof of the celebrated Edrei-Voiculescu theorem which describes the 
boundary of the Gelfand-Tsetlin graph as a region in an infinite-dimensional 
coordinate space. This graph encodes branching of irreducible characters of 
finite-dimensional unitary groups. Points of the boundary of the Gelfand- 
Tsetlin graph can be identified with finite indecomposable (= extreme) char- 
acters of the infinite-dimensional unitary group. An equivalent description 
identifies the boundary with the set of doubly infinite totally nonncgative se- 
quences. 

A principal ingredient of Borodin— Olshanski's proof is a new explicit deter- 
minantal formula for the number of semi-standard Young tableaux of a given 
skew shape (or of Gelfand-Tsetlin schemes of trapezoidal shape). We present 
a simpler and more direct derivation of that formula using the Cauchy— Binet 
summation involving the inverse Vandermonde matrix. We also obtain a q- 
generalization of that formula, namely, a new explicit determinantal formula 
for arbitrary (/-specializations of skew Schur polynomials. Its particular case 
is related to the q-Gelfand-Tsetlin graph and q-Toeplitz matrices introduced 
and studied by Gorin 1(71. 



1. Introduction 

We begin with describing (in combinatorial terms) main results of the present 
paper, namely, a formula for the number of Gelfand-Tsetlin schemes of trapezoidal 
shape, and its g-generalization. In |2] below we explain how our results are related 
to (and motivated by) the Edrei-Voiculescu theorem which describes the boundary 
of the Gelfand-Tsetlin graph. 

1.1. Signatures and Gelfand-Tsetlin schemes. A signature of length N is a 
nonincreasing ./V-tuple of integers v = > . . . > vjy) 6 Z . Let G1V denote 
the set of all signatures of length N (by agreement, GT = {<2>})- The set GTjv 
parametrizes irreducible representations of the unitary group U(N) [W , so in the 
literature signatures are sometimes called highest weights. Branching of irreducible 
representations of unitary groups leads to the notion of interlacing of signatures 
/i e GTjv-i, v € GUV: 

v\ > Hi > v 2 > ■ ■ . > vn-1 > MJV-i > »n- (1-1) 

Wc denote this interlacing relation between signatures by // -< v. By agreement, 
< A for all A e GUV 

2010 Mathematics Subject Classification. 05E10; 22E66; 31C35; 46L65. 

Key words and phrases. Gelfand-Tsetlin graph; trapezoidal Gelfand-Tsetlin schemes; Edrei- 
Voiculescu theorem; inverse Vandermonde matrix; q-deformation; skew Schur polynomials. 



2 



LEONID PETROV 



AN) 



y (A0 
V N-1 

\V b \V 

(AM) 
V N-1 



AN) 



.CAT-i) 



,(2) 



,12) 



„(') 



Figure 1. A Gelfand-Tsetlin scheme of depth N. 



A Gelfand-Tsetlin scheme of depth N is a growing interlacing sequence of sig- 
natures: 

Xl/ (2) ^...^^-D ^W, (1.2) 

One can also view this sequence as a triangular array of integers {^j" 1 "*} € Z N ( N+i y 2 
satisfying interlacing constraints indicated on Fig. [T] 

1.2. Gelfand-Tsetlin graph. The set of all signatures GT := |_ljv=o ^"^n is tra- 
ditionally equipped with a structure of a graded graph: we connect two signatures 
/i G GTat_i and v G GTjv by an edge iff fi -< za This graded graph GT is called 
the Gelfand-Tsetlin graph. 

A Gelfand-Tsetlin scheme with top row G GTjv is readily identified with a 
path in GT from the initial vertex G GTo to v. Let Dim^ v denote the total 
number of such paths. In fact |Wj . this number can be identified with the dimension 
of the irreducible representation of U(N) indexed by the signature v. 

Also, define the relative dimension Dim#:,jv(^> v) to be the number of paths 
in the Gelfand-Tsetlin graph from the vertex x G GT^ to the vertex v G GTjv, 
K < N. Such paths are identified with Gelfand-Tsetlin schemes of trapezoidal 
shape of depth N — K + 1 with top row v and bottom row k. If all the parts of >c 
and v are nonnegative, Dimx.A'(>f, v) also has an interpretation as the number of 
semi-standard Young tableaux of skew shape v j ' x filled with numbers K + 1, . . . , N 
[Ml Ch. I]. 



1.3. Projections in Gelfand-Tsetlin schemes. Consider the uniform proba- 
bility measure P N ' V on the set of all Gelfand-Tsetlin schemes (1.2) with fixed top 
row v G GTjv. Clearly, is supported on integer points inside some polyhe- 

dral region (of finite volume) in R*^ -1 )/ 2 (with coordinates v^ l \ . . . , v^ N ~ ls> ). Fix 
K < N and consider the projection of P^*" onto the Kth row (u[ , . . . , v^" 1 ) of 
the Gelfand-Tsetlin scheme. In this way, we get some (generally speaking, non- 
uniform) probability measure on GT^- C Z K . According to the notation of B02|, 
we denote the probability of a signature h G GT#- under this projected measure 
by A^(f, x). Following [BOT], we call the stochastic matrix (= Markov transition 
kernel) A^ of dimensions GTjv X GT^ (K < N) the link from GTjy to GT^- 
It is readily seen that 



(1.3) 
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As explained below in f|2j the Edrei-Voiculescu theorem (our main motivation 
in the present paper) boils down to the following question about the asymptotic 
behavior of the links (equivalent formulations of that theorem are discussed in |2]) : 



Question 1.1. Describe all possible sequences of signatures v{\), f(2), . . ., where 
v(N) € GT^v, such that for every fixed level K and signature k € GT^, the 
sequence {A^(v(N), x)}n>i has a limit as N goes to infinity. Such sequences 
{v(N)} are called regular. 

The signatures v{i)'s do not need to interlace. Note that A^(f(JV),x) is well- 
defined only for N > K, but since K is fixed and N —> oo, the above question is 
well-posed. 

A possible approach to answering Question 1 1 . 1 1 would be to obtain an explicit ex- 
pression for the quantities Dim^jv^, V {N))/ Dimjv(^(A)) (the A-dependent part 



of (1.3)) adapted to the desired asymptotic regime. Such an expression was first 
presented in |BQ2i Prop. 6.2]. We obtain an equivalent form of that expression 
(Theorem [l~2] below). 



1.4. Number of trapezoidal Gelfand Tsetlin schemes. For v G GTjv, denote 

njv z + r 
- ■ (1-4) 
r=l z + r - v r K ' 

Theorem 1.2. For any 1 < K < N, >c G GTr-, and v G GTjy, we have the 
following formula: 

— = det [A^Xj - j l7 1.5 

wher^\ 

A i (x) = A i (x\K,N,v):=^f^<£ {z ~ X + 1)n - k ~ 1 H*{z-,u)dz. (1.6) 

Here the positively (counter-clockwise) oriented simple contour €(x) encircles points 
x, x + 1, . . . , v± — 1, and not the possible poles x — 1, x — 2, ... , vn — N coming 
from H* (z; v). 



Proposition 1.3. Formula (1.5) is equivalent to [BQ21 Prop. 6.2]. 



Theorem |1.2| admits a rather simple and direct proof which uses the Cauchy- 
Binet summation involving the inverse Vandermonde matrix. We present proofs of 
Theorem |1.2| and Proposition |1.3| in S|4j 

Remarks 1.4. 1. Since the quantity Dimjv v is given by a simple product for- 



mula (3.10), Theorem 1.2 essentially provides an explicit formula for the number 
of Gelfand-Tsetlin schemes of a given trapezoidal shape. 

2. It is known that the uniform measure P-^'" viewed as a measure on interlacing 
particle arrays (see Fig. [2]) is a determinantal point process. In Theorem 5.1 in [P] 
the correlation kernel of this measure was expressed as a double contour integral. 
This implies the existence of a K x K determinantal formula for the left-hand 



side of (1.5) with matrix elements expressed as double contour integrals. However, 
Theorem |1.2| provides a simpler formula involving only single contour integrals. 



^Here and below (y) m '■= y(y + 1) • • ■ (y + fn — 1), m = 1, 2, . . . (with (y)o := 1) denotes the 
Pochhammer symbol. 
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The formula of Theorem 1 1 . 2| provides a very useful tool to approach Question [O] 
Indeed, in Question |1.1| the level K and the signature k e GT#- are fixed, and the 
li mit tr ansition involves taking large N and varying v(N). Since the determinant 
in ( 1.5 1 is of fixed size K x K, in order to understand the behavior of A^(i/(N), x), 
one can start by considering asymptotics of the individual matrix elements Ai(x \ 
K,N,i/(N)) ( |1.6| , where i and x are fixed. It turns out that every Ai(x) has 
a nice asymptotic behavior, and in this way Question |1.1| may be resolved. We 
discuss an approach to Question 1 1 . 1| using Theorem |1.2| in more detail in |2]and Sj5] 
This method (using a formula equivalent to ( |1.5[ )) was suggested and carried out 
in [BQ2j . 



1.5. g-generalization. There is a q-def orm ation of Theorem |1.2| which replaces 
the uniform probability measure 1.3 ) by its certain q- version. The most 

general result in this direction we obtain is formulated in [6.1 (Theorem 6.1) in 
terms of ^-specializations of skew Schur polynomials. 

Here let us formulate a particular case related to the q-deformation of the 
Gelfand-Tsetlin graph introduced in [G] (we recall the definition of the q-deformed 
graph in 1 6.5[ ). Let us interpret Gelfand-Tse tlin schemes as 3D stepped surfaces 
(see Fig.K), and set the weight of each scheme (1.2) proportional to q vo \ where vol is 



the (suitably defined) volume under the corresponding stepped surface. Such mea- 
sures on 3D stepped surfaces inside a finite shape were considered in, e.g., [CKPJ, 

[ED], [HUH], 0. 




Figure 2. Putting n particles (red dots) 
1, . . . , n, on each nth horizontal line, n — 1, . 



,N 



(n) ■ ■ 

V) ' ~ J, J = 

we obtain from 



the Gelfand-Tsetlin scheme (1.2) an interlacing particle configu- 



ration (\3.7) that can be interpreted as a lozenge tiling of the 



horizontal strip < n < N with N small triangles added on top. 
This tiling may be also viewed as a 3D stepped surface. 



We will always assume that < q < 1. In the present paper we stick to the 



convention that the volume of a Gelfand-Tsetlin scheme (1.2) is equal to 



mo\{v 



(i) 



-< . .. -< v 



(iV-l) 



< V 



N-l 
n=l 



»l 



»l — „w 



(1.7) 
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Observe that we are summing over N — 1 signatures because the iVth signature 
uW = v is assumed to be fixed. Define the q-measure q P N:L/ on the set of all 
Gelfand-Tsetlin schemes with fixed top row v G G1V by 



< .. . <v 



(N- 



1] -< !/) := 



f 



Dim jv f 



(1.8) 



where g Dim^v z/ is a normalizing factor (partition function of the g-weighted tri- 



angular Gelfand-Tsetlin schemes). This is a g-analogue of Dim^r v defined in \ 1.2 
(see also { 3.4). 



We define the q-links q K^ from G1V to GTk (K < N ) us ing projections of 
the measure q P N,v in the same way as it was for q = 1 in {1.3 One can readily 
define the g-analogue q Dirn/vif (*c, v) of the number of trapezoidal Gelfand-Tsetlin 
schemes (see {6.3), so that 

q T>im KtN (x, v) 



q Ax(v, x) = q V>\ni K . 



(1.9) 



q Dimjy v 

Theorem 1.5. For any 1 < K < N, >c E GTV, and v E GTjy, we have the 
following formula: 



q Dim KiN (x, v) 
q Dimjv v 

wher^\ 



( — 1) K) q{N—K) | yc\ ^— K(N— K) ( AT+2) /2 det[gA . {){ . _ j)}*^ 

(1.10) 



q Ai(x) = q Ai(x | K,N,v) := 



2?ri 



dz 



{zq 1 x ;q) 



N-K-l 



z-q 



t(x) n 



N—K+i 



N 

(•-- - } ! 



(i.ii) 

ifere the positively (counter-clockwise) oriented simple contour q <L(x) encircles points 



q ,Q 



,9 



i/i-i 



and not £/ie possible poles q 



x-1 „x-2 



,q- 



v N -N 



1 limit, Theorem 1.5 becomes Theorem 1.2 



Proposition 1.6. In the q 

Remark 1.7 (cf. Remark 1.4 2). The determinantal kernel of the measure q -iP N,u 
on Gelfand-Tsetlin schemes was computed in [Pj Thm. 4.1]. This result readily 
implies (by replacing q by g _1 ) the existence of a K x K determinantal formula as 



in (1.10) but with a much more complicated kernel expressed as a double contour 
integral containing a g-hypergeometric function 201 inside. It seems remarkable 
that the technique of the present paper allows to obtain a much simpler single 
contour integral expression ( |1.11[ ) for these matrix elements. 

We obtain Theorem |1.5| in {|6] as a corollary of a more general Theorem |6.1| 
The latter deals with a larger class of g -mea sures on Gelfand-Tsetlin schemes than 
q P N ' v . We also explain how Theorem 



1.5 



is related to the work of Gorin 



on 



the boundary of the g- Gelfand-Tsetlin graph and g-Toeplitz matrices. General ad- 



measures on Gelfand-Tsetlin schemes whose projections (defined similarly to (1.9); 
see Remark 6.2) we compute in Theorem 6.1 allow to define other g-dcformations 



of the classical Gelfand-Tsetlin graph. We plan to investigate boundaries of such 
deformations in a subsequent publication. 



2 Here and below (a;q) m : = (1 — a)(l 
denotes the q-Pochhammer symbol. 



aq) ... (1 — aq m 1 ), m = 1,2,... (with (a; q) r . 



1) 
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1.6. Organization of the paper. In f|2] we briefly recall necessary definitions 
and results related to the Edrei-Voiculescu theorem describing the boundary of 
the Gelfand-Tsetlin graph. We also discuss various interpretations of these results 



in §{ 2.4 2.5 The material of the latter two subsections is included to provide 



more background and motivations. In {2.6 we explain an approach to the Edrei- 
Voiculescu theorem employed in |BQ2j . 

In Sj3]wc recall the Laurent-Schur polynomials which provide a convenient alge- 
braic framework for our proofs. 



In f]4]we prove Theorem 1.2 and show its equivalence to the Borodin-Olshanski's 



formula |BQ2I Prop. 6.2] . Then in f|5]we briefly explain how the formula of Theorem 
L2] leads to the Edrei-Voiculescu theorem. 

In we establish ^-extensions of our results some of which are described in 
§1.5| In particular, we obtain Theorem 1 1. 5 1 as a corollary of a more general result 



(Theorem 6.1 1 on (/-specializations of skew Schur polynomials. 



Remark 1.8. We have decided to present the proof of Theorem |1.2| not as a 



q /• 1 limit of Theorem |l.5| (cf Proposition 1.6 1, but give instead a straightforward 
derivation in the q = 1 case which uses simpler notation than the argument for 
< q < 1. This allows to make the part of the paper about the "classical" (q = 1) 
situation self-contained (e.g., in contrast with (Pj). 

1.7. Acknowledgments. I am very grateful to Grigori Olshanski for drawing my 
attention to the problem, and to Alexei Borodin for useful comments. I would also 
like to thank Vadim Gorin for discussions regarding g-analogues. The work was 
partially supported by the RFBR-CNRS grants 10-01-93114 and 11-01-93105. 

2. The boundary of the Gelfand-Tsetlin graph 

2.1. Coherent systems. There are several equivalent ways to define the boundary 
of a graded graph (such as the Gelfand-Tsetlin graph). Following, e.g., [BQ2| . we 
use the notion of coherent systems. 

Definition 2.1. Let Mm be a probability measure on GTjy for each N . The se- 
quence {-M/v} is called a coherent system on GT if the measures are compatible 



with the links A%_ 1 ((1.3 1 



MnA^ = M N -x, N>1, 



or, in more detail (see (1.3) and note that Dimjv_i jv(/i, A) = 1 if jj, -< A) 



Afj V (^) D ™ jV ~ 1 - = M N -i(ji), V M e GTjv-i- (2.1) 

DlITljv V 



E 



Coherent systems on GT form a convex set. A coherent system {Mn} is called 
extreme if it cannot be represented as a nontrivial convex combination Mjv — 
pM' N + (1 - p)M'^, < p < 1, of two other coherent systems {M' N }, {M'£}. 

Definition 2.2. The boundary 9(GT) of the Gelfand-Tsetlin graph GT is, by 
definition, the set of all extreme coherent systems on GT. 

About connections of this notion with the minimal entrance boundary of a 
Markov chain, e.g., see [BQ21 §2.2] and references therein. 
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2.2. Connection to Question Let us briefly discuss the Vershik-Kerov's 
idea (employed in, e.g., jV], [VKlj . |VK2) . |VK3j . |VK4| ) of approximating elements 
of the boundary <9(GT) (= extreme coherent system^) by their finite- iV analogues. 

Consider the part of the Gelfand-Tsetlin graph GT(N) := GT U . . . U GT N 
up to some fixed level N. Coherent systems on GT(A^) are defined in the same 
way as for the whole graph GT. Extreme coherent systems on GT(iV) are in bijec- 
tion with signatures v £ GTjy- Namely, the extreme coherent system on GT(A) 
corresponding to v e GTw looks as 

m£^=A£<L=A£(iv), K = 0,1,...,N-1, (2.2) 

where 5 V is the Dirac delta measure on GTjy supported at v, and is the link ( 1.3 1. 

As shown in jV] (see also |VKlj ). every extreme coherent system on GT is a limit 
of those on GT(iV) as N — > oo. (The convergence of coherent systems is understood 
as (weak) convergence of their members, i.e., of the corresponding measures on 
GTk for every fixed K = 1, 2, . . ..) In detail, for every extreme coherent system 
{Mk}k=o 011 there exists a sequence of signatures v(N) € GT^ {v(N) is the 
index of the extreme coherent system on GT(7V) for each N) such that for every 
fixed K and x € GT^ one has 

lim M { "' v[N) \x) = M k (k), 

N-^-OO 



where M { ^ MN)) is defined in \2.2) . We see that in this way the problem of de- 



scribing the boundary <9(GT) becomes equivalent to Question The sequence of 
signatures {v(N)} above is the same as the regular sequence of Question 

2.3. Description of the boundary. Let f2 be a subset of the infinite-dimensional 
coordinate space M 4oo+2 defined by the following conditions: 

n:= ^ = (a+ 7 (3 + ;a-,f3-;5 + ,5-): af > af > . . . > 0; ft > ft > . . . > 0; 

* — '1=1 

As a subset of M 4oo+2 equipped with the product topology, the space Q is locally 
compact. Set 7 ± := 5 ± - EZA a t~ + Pf) > °- 

Let T:= {iieC: \u\ — 1} be the unit circle. Define the following function on T 
depending on u G Q: 

*(«;«) - e^«-> w 1 -) n | +A v ( ;'lll +A -r 1 r!l - m 

7=1 1 ~ a : i( U - !) 1 ~ a i ( U !) 

Note that 3>(l;u;) = 1. Expand the function $(it;oj) as a Laurent series in u: 

oo 

*(u;w) = <Pn(")u n - (2.4) 



n=— oo 



The Laurent coefficients tp n {w) ar< 3 themselves functions in uj S f2. They admit the 
following contour integral representations: 



^" H= 2rdi $(M;w) ^' UeZ - (2 ' 5) 

^Vershik and Kerov actually used an equivalent notion of extreme central measures on paths 
in the Gelfand-Tsetlin graph. 
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Using the functions (p n (u>), define for every signature v G GT^v: 
tp v (u) := det[^„ 4 _i+j(a;)]^ =1 . 
Let the link from to QTk for every K be defined as 

Aj£ (w, x) := Dimif >r • <p x (uj), well, >r € GTr-. 

It is not hard to show that (e.g., see |BQ21 Prop. 2.9]): 
• A J? is indeed a link, i.e., 



A£( W ,^)>0, 



A£(w,x) = l. 



(2.6) 
(2.7) 



The links A£ and Af are compatible in the sense that A^"A£ = Af for K < N 



I-', 



Nfl* 



\Nc4 



y + 2 



FIGURE 3. Components (a ± (v),(3 ± (v),5 ± (v)) of the image u{v) 
of the signature v € GT^r under the embedding GTjv fi. In 
this example N — 7 and i/ = (4, 2, 0, 0,-1, -1, -3). 



Definition 2.3. Along with the links from f2 to GTjv, define embeddings GTjv 
f2, i/ h-> for iV = 1,2,... as follows. Write the signature v as a union of 

"positive" and "negative" Young diagrams (= partitions, see [MJ Chapter 1.1]) 

v = {ft, ■ ■ ■ , V£+, -v~_ -i/f ), vf > . . . > vf± > 0. 

Components (a^(i>), f3 ± {v)^ 6 ± (u)) of the image <jj(u) look as (see Fig. [3]) 



1/2 



1/2 



N 



N N 
where (v^)' is the tran spos ed Young diagram, and \v | denotes the number of 
boxes in a diagram (in (1.7), \v\ = — \v~\). By agreement, if — i < 0, we 



set af(v) = 0, and similarly for (3f(y). 

Theorem 2.4 (Edrei-Voiculescu) . There is a bijection between the boundary d(GT) 
of the Gelfand-Tsetlin graph and the space Q defined above. More precisely, 

1. The extreme coherent system {Mjy } corresponding to a point uj € fl has the 
form (cf. (2jfy) 



M$\v)=A%(u,v), for all N = 1,2, 



and v € GT 



N- 
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2. For an extreme coherent system {Mjv}, the corresponding point o/O is obtained 
as follows. Let w(Afjy) denote the push-forward of the measure Afjy under the 
embedding GTjy Then the measures uj(Mn) on Q weakly converge to the 

delta measure which is supported at the point of £1 corresponding to {Mj\r}. 

In this form the Edrei-Voiculescu theorem was established in |VK3j (this is a 
note without proofs) and |OOj . The latter paper's proof is based on the Binomial 
Formula for Schur (more generally, Jack) symmetric polynomials. In §§274 2.5 we 



describe equivalent formulations of Theorem|2.4| In §2.6|we explain the novel direct 



approach of Borodin and Olshanski [B02] to Theorem 2.4 and put our result of 
Theorem 11.21 in that framework. 



Remark 2.5. In the setting of Question |1.1[ Theorem 2A_ means that regular 



sequences of signatures {v(N)}, v{N) G GTjy, are characterized by the property 
that all rows, all columns of the Young diagrams v ± (N) 1 as well as their numbers 
of boxes |^ ± (A^)| (cf. Definition 2.3 and Fig. [3]) grow at most linearly in N. 



2.4. Representation-theoretic interpretation. Consider the increasing chain 
of finite-dimensional unitary groups 

17(1) C 17(2) C 17(3) C . . . , (2.8) 

where the inclusions are defined as 

~U 0" 



U(N-l) 3U^ 



1 



G £7(77). (2.9) 



Let U(oo) be the union of the (7(iV)'s ( |2.8| . We equip f7(oo) with the inductive 
limit topologyj^j Every element U G U(oo) lies in some U(N) for large enough N, 
and thus has eigenvalues (ui, . . . , Un, 1,1,.. .), it, G T. 

Definition 2.6. A character \ 01 J7(oo) is a function x- U(oo) —> C which is 

• continuous in the topology of U(oo) (i.e., restriction of x to every U(N) is con- 
tinuous) ; 

• constant on conjugacy classes of Z7(oo); 

• positive definite; 

• normalized so that x(e) = 1, where e = diag(l, 1, . . .) G £7(oo) is the unity of the 
group. 

Characters form a convex set, and so extreme characters can be defined as extreme 



points of that set similarly to Definition 2.1 



Extreme characters can be defined for any topological group. They serve as a 
natural replacement for the notion of irreducible characters (the latter make sense 
for, e.g., compact groups such as the U(N)'s). Extreme characters of U(oo) corre- 
spond to its finite factor representations |Voi| . In that paper, Voiculescu presented 
a list of extreme characters of U (00) which are indexed by points of the space O 
(i |2.3| ), and partially established completeness of that list. The value of the extreme 
character x corresponding to to G fl at an element U G J7(oo) with eigenvalues 
(ui,...,uat,1,1,...) is 

X^(U) = $( Ui ;u;)-...-$(u n ;gj)= JJ *(u;w), (2.10) 

uGspcctrum of U 

^In fact, in this topology U(oo) is neither a compact, nor even a locally compact group. 
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where uj) is given in (2.3). In [VK3j the problem of describing characters of 
U(oo) was connected to the combinatorial Question |1.1| (see {2.2). A connection 
of Voiculescu's work with earlier results on totally nonnegative Toeplitz matrices 



(see {2.5) was discovered in Boy|. 



It should be mentioned that for the infinite symmetric group the same problem 
of classification of characters was solved by Thoma [Thj . 

For the finite-dimensional unitary groups U (N) themselves, the extreme charac- 
ters are precisely their normalized irreducible characters 

■ u (m, . . .,u N ) 



,(ui, . . . ,u N ) 



v e GT N 



(where s„'s are the Laurent-Schur polynomials (3.1)). Here u\, . 
values of a unitary matrix U € U{N). The denominator s„(l, . . 



(2.11) 

. , un are eigen- 
, 1) = Dim^v v is 

the dimension of the irreducible representation. This number also has a combinato- 
rial interpretation as the number of Gelfand-Tsetlin schemes with fixed top row v 
({ 1.2 1. The extreme characters of U(oo) are U N = oo" analogues of the normalized 



irreducible characters s„ of the U(N)'a (cf. {2.2). 

Let us explain the connection of characters of U(oo) with coherent systems on 
the Gelfand-Tsetlin graph (j ]2.1| ). Restricting any character \ of U(oo) to U(N) C 
{/(oo), one gets a normalized (but not necessary irreducible even if \ was extreme) 
character of U(N). Let us write it as a linear combination of the normalized 
irreducibles s u with some coefficients Mjv(f) : 



X\ 



M N (v)~s v 



(2.12) 



The numbers {Mn(v)} u£ qt n are nonnegative and sum to one, so they define a 
probability measure on GTjv- Moreover, from the branching rule for the Laurent- 
Schur polynomials (j ]3.3| it follows that the probability measures Mjf on GT^r 
form a coherent system on <GT. In this way, characters of {/(oo) are in one-to- 
one correspondence with coherent systems on the Gelfand-Tsetlin graph. Extreme 
characters correspond via (2.12) to extreme coherent systems. Thus, the result of 
Voiculescu on extreme characters of {/(oo) is reformulated as Theorem 2.4 This 
reformulation is due to Vcrshik and Kerov, see citations in 92.21 



2.5. Totally nonnegative Toeplitz matrices. 

Definition 2.7. Let {6 n }„ 6 z be a sequence of nonnegative numbers such that 
J2 n bn = 1. Consider the (doubly infinite) Toeplitz matrix B := [bj-i]ij e z- The 
Toeplitz matrix B and the sequence {b n } are called totally nonnegative if all the 
minors (i.e., determinants of submatrices) of any order of the matrix B are non- 
negative. 

Totally nonnegative Toeplitz matrices were classified by Edrei |E2j (see also 
AESW , ASW]). The answ er i s that they are indexed by points of the same 
infinite-dimensional space f2 ({2.3). The generating function of the sequence {bn } 



corresponding to uj € has the form 



$(w; uj) 



where &(u;uj) is defined in (2.3). In the notation of { 



2.3 



6 M 



<Pn(<*>)- 



It is worth noting that the classification of triangular totally nonnegative Toeplitz 
matrices (i.e., with 6_„ = 0, n = 1, 2, . . . in Definition 2.7) which is also due to 
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Edrei El (see also AESW ), is equivalent to Thoma's description |Th] of extreme 
characters of the infinite symmetric group. 

Let us now explain how doubly infinite totally nonnegative Toeplitz matrices are 
related to the boundary of the Gelfand-Tsetlin graph. First, we need a lemma: 

Lemma 2.8. Let a function B(u), be expressed as a Laurent series B(u) = 

XlnGZ b n u n ■ Then for iti, . . . , ujv € T, we have 



B( Ul 



Then for Ui, 
■...■B{u N ) 



c „ det[b Vi - i+j ] 



N 



s v (ui, . . . ,u N ). 



(2.13) 



Proof. This is a straightforward computation, e.g., see |Voi[ Lemme 2]. 

Let us make a comment that the product B(u\) . . . B(un) is a Laurent series 
in Mi, . . . , ujv which is of course symmetric in these variables. On the other hand, 
the Laurent-Schur polynomials s„(iti, . . . ,itjv), where v ranges over GTjy, form a 



linear basis in the space M.[uf i , . . . , m^ 1 ] 6 ^ of symmetric Laurent polynomials 
([JOJ. Identity ( 2.13 1 is the explicit form of a representation of B(u\) . . . B(un) as 
an (infinite) linear combination of the s„(iti, . . . , mjv)'s. □ 



2.5.1. From Toeplitz matrices to coherent systems. Clearly, det[6^ 



liY 



_-, is a 



minor of the Toeplitz matrix B of Definition 2.7 If B is totally nonnegative, then 
all the determinants of this form are nonnegative. Moreover, using the branching 
of Laurent-Schur polynomials (j|3.3[), one can readily check that the numbers 



Mn(v) = Dimjv v ■ det[6 Wi 



-M-jJi,j=l! 



v e CIV, 



satisfy (2.1|. Thus, {Mn} is a coherent system on the Gelfand-Tsetlin graph. 



Moreover, it can be shown (e.g., see [SVj or the approach of Ols ) that coherent 
systems of this forrrj^] are extreme. In this way Edrei's classification of totally 
nonnegative Toeplitz matrices leads to Theorem |2.4| 



2.5.2. From coherent systems and characters to Toeplitz matrices. If {Mjy} is an 
extreme coherent system on the Gelfand-Tsetlin graph corresponding to a point 
lu € fi (fOL then from (|2.10[), (pT2|), and (|2.13[) we have M N (v) = Dim^ u-tp„(w), 



where ip„(lj) is de fined in (2.6). The fact that we start from a character of U(po) 
implies (via (2.12)) that all the minors of the form <p v {u>) — det[ip Ui -i^-j(oj)]^j =1 
for any JV and any v G GTjy are nonnegative. These minors do not exhaust 
all possible minors. However, their nonnegativity is enough to conclude that the 
Toeplitz matrix \<j>j—% (^)]i,jeZ is totally nonnegative (e.g., see |FZ1 Thm. 9] and 



references after that Theorem). Thus, Theorem 2.4 implies the result of Edrei on 
totally nonnegative Toeplitz matrices. 

2.6. Uniform Ap prox imation Theorem. Nowadays, there exist three different 
proofs of Theorem |2.4| 6 | The original works of Edrei and Voiculescu used theory of 
functions of a com plex variable. The approach of |00j (outlined in jVKlj . [V K3 ) 
answered Question |l.l| about asymptotic behavior of the links (see also { 2.2 ) 



by considering their generating function (in certain sense) and using the Binomial 
Theorem for Schur polynomials. 



^That is, whose generating functions J^i/gGTjy Mn(i/)s v ,{v.\, 
i 2.11 1 and Lemma 2.8 i are multiplicative in u\ , . . . , nj\r. 



. , ujv) = B(ui) . . . B('ujv) (see 



is worth mentioning that yet another new way of establishing this theorem will appear soon 
in ICTH . 
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The th ird, novel approach of L502J is based on a di rect explicit formula for the 
links (1.3 1 which is equivalent to our Theorem 1.2 Using such a formula, it is 



possible to establish the following (see ^5] and also [B021 §§7-8]): 
Theorem 2.9 (Uniform Approximation Theorem |BQ21 §3]). The finite-N links 



1.3) are uniformly close to their "N — oo " analogues \2. ly in the sense that for 
any fixed K = 1, 2, . . . and x G we have 

lim sup |A£(i/,x) -Ag(u;(z/),x)| = 0, 



where lo{v) £ Q is described in Definition\2. 

B02, §3], using some properties of the space and of the 



As explained in 



functions tp n (uj) (2.5 1 on it, it is possible to deduce Theorem 12^41 from Theorem |2.9 
In fact, Theorem |2.9| also naturally implies an equivalent claim that the set of all 
(not necessary extreme) coherent systems on the Gelfand-Tsetlin graph is in a 
bijection with the space of Borel probability measures on f2, see |BQ2l §2.8]. 
In §S] we will outline a proof of Theorem |2.9| using our result of Theorem L2 



3. Laurent-Schur polynomials 

In this section we collect various definitions and results related to the Laurent- 
Schur polynomials. Most of them can be found in one form or another in [Ml Ch. 
I]. Laurent-Schur polynomials provide a convenient framework for our proofs of 
Theorems |1.2| and |1.5| Although the proof of Theorem |1.2| can be given without 
any reference to Laurent-Schur polynomials, we use them in our proof in §3] so 
that the "classical" (q = 1) situation can be compared with its q-deformation 
discussed in 

3.1. Definition. Consider the space B^it^ 1 , . . . , u^ 1 ] 6 ^ of symmetric Laurent 
polynomials in N variables u\, . . . ,Un- A linear basis in this space is formed by 
the Laurent-Schur polynomials 

det[u? +N ~ J }? 1=1 

S v {m, . . .,U N ) = N-nM ' ' v£t&Y N , (3.1) 

det[u, J ]^- =1 

indexed by all signatures of length N . Each s v {u\, . . . , um) is a homogeneous sym- 
metric polynomial in u 1 1 , . . . , w^ 1 of degree |^| = v\ + . . . + Vjsr € Z (this number 
is not necessary nonnegative) . In particular, s# = 1. 



Note that the denominator in (3.1) is simply the Vandermonde determinant 

V( Ul , ...,u N ):= det[u?~% =1 = JJ . <N (u t -u 3 ). (3.2) 

For nonnegative signatures v (i.e., for which v\ > . . . > vpf > 0), the Laurent- 
Schur polynomials become the ordinary Schur polynomials (which are honest sym- 
metric polynomials in the variables u\, . . . , un). The ordinary Schur polynomials 
possess the stability property: 

s v {u x , . . .,u N ,u N+1 = 0) = s„(ui, . . . ,u N ). 

(We append nonnegative signatures by zeroes as v = (vi, . . . , Vf_, 0, 0, . . .), where I 
is the number of positive parts in v.) 

The Laurent-Schur polynomials s u {u\, . . . , un), v G GTjv (if u\, . . . , it/v G T 
are viewed as the eigenvalues of a matrix U G U(N)), are exactly the irreducible 
characters of the unitary group U (N) jW] . 
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3.2. Particular cases: e— and h— polynomials. Particular cases of Schur polyno- 
mials indexed by nonnegative signatures are the elementary symmetric polynomials 

e m (ui, ■ ■ ■ , u N ) := s (1) ^ l,o,...,o)( u i' • • ■■> u n) (3-3) 

and the complete homogeneous symmetric polynomials 

h m (ui,. . . ,U N ) ■= S(m,0,...,0)("l ! • ■ -,un)- (3.4) 
By agreement, in TV variables we have 

e = 1, e _! = e_ 2 = . . • = 0, e^+i = e N+2 = . . . = 0; 
ho = 1, = /i_2 = . . . = 0. 

The generating functions of the e m 's and the /i m 's are given by (we write them in 
these forms for later convenience) 

w N ~ i (-iye l (u 1 ,...,u N )=T\ N (w-u r ); (3.5) 

EL 4 ^'-' tt ^ = l£lxi^M- (3 - 6) 

3.3. Branching. Having an irreducible character s^iii, . . . , mat) of the unitary 
group U(N), one can restrict it to the subgroup U(N — 1) (see |2.4[ ) and represent 
it as a linear combination of irreducible characters of ?7(iV — 1). This leads to the 
following branching rule |W| : 

s v (u\, ... ,it/v-i;«jv = 1) = ^ s m (mi, . . . ,u/v-i), (3.7) 

where the sum is taken over all signatures /i which interlace with v ( |1.1[ ). In fact, 
a more general formula takes place: 

S^tti,..., U N -!,U N ) „_ s ai (mi,...,uat_i)u^ I_ImI . 

Continuing expansion for itjv-i, wjv-2j we arrive at the following combina- 

torial formula for the Schur polynomials: 

, r« « ^- V ,> (1> L> (a) H" (1, l „k w l-k (N - 1) l f o Sl 

0^uW^...^u>. N )=u 

where the sum is taken over all Gelfand-Tsetlin schemes with fixed top row iA N ' — 
v € GT N . 

3.4. Number of triangular Gelfand-Tsetlin schemes. Combinatorial formula 



( 3.8 ) readily implies that the number Dim^v v of triangular Gelfand-Tsetlin schemes 



with top row v S GTjv (§* 1.1 - 1.2 ) is equal to 

Dim. N u = s v (l,...,l) for all N = 1,2,..., and v e GT N . (3.9) 

N 



This number can be computed via its (/-deformation using (3.1) 



det^- 1 )^-')]^ V(q^- N ,...,q^) 
s v (l,q,...,q )- - 



det[ g (-l)(^)]f ?=1 V(q-\...,q-") ' 
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where V(-) is the Vandermonde determinant (3.2). Taking the q /* 1 limit above, 
we arrive at the following product formula: 

V{v x -l,...,v N -N) 



Dinijv v = 



V(-l, 



-N) 



n 

l<i<j<N 



Vj - Vj + 3 - \ 
j-i 



(3.10) 



Remark 3.1. In fact, as follows from (3i 
given by 



the normalizing constant in (1. 



is 



, Diixijv v = s v (l,q, 



n 

l<i<j<N 



-i - q-j 



(3.11) 



3.5. Skew polynomials. For two signatures x G G1V and v G GTjv, K < N, 
define the skew Laurent-Schur polynomial by the following combinatorial formula: 



+ 1- 



,U N ) 



E 

=v( K )^ K + 1 )-<...-<v( N ^ 



1 K+1 



H* (K) I„> 



(K + 2) 



(3.12) 

|„W|_|„(JV-i)| 



"K+2 



where the sum is taken over all Gclfand-Tsetlin schemes (of depth N — K + 1) of 
trapezoidal shape with fixed top row v € GTn and bottom row x € GT^- The 
skew polynomial s v / ^ is also a homogeneous Laurent polynomial, it has degree 
\v\ — \x\. When all the parts of the signatures v and x are nonnegative, this is an 
ordinary (not Laurent) polynomial in Uk+i, ■ ■ ■ , un- in particular, s u / = s v . 
There is an identity which readily follows from (3.8) and (3.12): 

s v {u x , 



.,u N ) 



f (ui,...,UK)s v /,t(UK + i,...,Uff), V G GTat, (3.13) 



where K < N is arbitrary and fixed, and the sum is taken over all signatures 
x G GTr-. Observe that this sum is actually finite. 

Formula (3.12 ) readily implies that the relative dimension Dimxjv(>f, v) {= num- 
ber of trapezoidal Gelfand-Tsetlin schemes, £1.2) is given in terms of skew Schur 
polynomials as 



Dim^Ar^, v) = s u / st {l, . . . , 1), 

N-K 



i/eGTw, xeGY K , K < N. (3.14) 



This is a generalization of formula (3.9) above. 

3.6. Jacobi Trudi identities. It is known that every symmetric (ordinary, not 
Laurent) polynomial can be expressed as a polynomial in the elementary symmetric 
polynomials e m . The following Jacobi-Trudi identity provides an explicit expression 
of this sort for the skew Schur polynomial s^/^ [y G GTjv, x G GT^), if all the 
parts of the signatures v and x are nonnegative: 

Sv/k(u k +i, ■ ■ -,un) = det [e^_^ +J -_i(uj<-+i, ■ • - ,«iv)]' Fl , 

where x 1 and v' are the transposed Young diagrams, and I is any sufficiently large 
number. By agreement, we always append nonnegative signatures by zeroes: v = 
(i/i,...,i/jv,0,0, ...), and x= (xi, . . . , x K , 0, 0, . . .). 

There is also a dual identity (again for nonnegative signatures x and v): 

Sv/x{uk+i, ■ ■ -,u N ) = det [h Vi -H j+ j-i(uK+i, ■ ■ ■^ v >N)] i ^ =v (3.15) 
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which has advantages that it involves the signatures x and v themselves, and not 
their transpositions, and also that the size of the determinant can be taken equal 
to N (one can take any larger size as well). 

A special case of (3.15) is a formula for the ordinary Schur polynomials 

8 u (ui,...,UN)=det[h Ui+ j-i(ui,...,UN)]. d=v v£&T N , v n >0- (3.16) 

3.7. Interlacing arrays. When working with signatures and Gclfand-Tsctlin sche- 
mes, it is sometimes useful to introduce shifted coordinates and regard every sig- 
nature as a configuration of distinct particles on the integer lattice. Namely, let 
i/W -< . . . -4 U ( N ) be a Gelfand-Tsetlin scheme. Set 

*? '■= "j m) ~ 3> m = l,...,N, j = l,...,m. 
The array {x.™ 1 } satisfies the interlacing constraints 

x ™ i < x " i_1 ^ X T ( 3 - 17 ) 

(for all j's and m's for which these inequalities can be written out), cf. j |l.l| and 
Fig. [TJ The configuration of particles at positions (x™,m) on the two-dimensional 
integer lattice can be interpreted as a lozenge tiling, see Fig. [2] 

3.8. Skew polynomials in one variable. Let us consider the case when there is 
only one variable, say, u. Then we have (here and below 1{...} denotes the indicator 
of a set) 

h m (u) = l m >o ■ u m , m e Z, (3.18) 
and for any two signatures v £ GTjy, x £ GTk (cf. |B21 (7)]): 

Su/A u ) = < „ . (3-19) 

10, otherwise. 

We see that s v / ie (u) vanishes unless K = N — 1 and the signature k interlaces with 
v as in ( 1.1 1. 

We have the following determinantal formula (for nonnegative signatures x 
and v\ recall that we append them by zeroes) which follows from the Jacobi-Trudi 
identity (3.15) and from (3.18) 

e v/ „(u) - det [l Vi -i>^-i ■ u^-O-to-'')]^. (3.20) 

Let us introduce a variant of this determinantal formula which works for arbitrary 
(not necessary nonnegative) signatures. It is based on the idea of virtual particles, 
e.g., see |B11 §4], and also |BK] , Similar idea was employed in [P, §4 |. L et v^ N ' £ 
GTjv, and v^ N ^ £ GTjy-i- Consider the particles xf ,xf " x as in (j3?7[. Let, by 
agreement, xj^ _1 = virt be a virtual particle. Denote 

Cu{x,y) := u y - x l x < y + u v l x=virt , x £ {virt} U Z, y £ Z. (3.21) 
Informally, if \u\ < 1, one can think that virt = — oo. Then 

s vW/ „ lN -v(u) = u N ■ det [^(xf^xf )]^ =i . (3.22) 

This determinantal formula follows from (3.19). The additional factor u N comes 
form the fact that 



"xf-^xf-^i.wi-i^- 1 )!-^ 

J — I J — '1=1 
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From (3.12) and (3.22) it follows that the skew Schur polynomial Syj^ for any v 
and k can be written as a sum of products of determinants. We use such a formula 
in our proof of Theorem |1.2| in the next section, and also in Sj6j 

4. Number of trapezoidal Gelfand-Tsetlin schemes 
(proof of Theorem 1.2) 

4.1. Cauchy Binet formula. Let us recall the well-known Cauchy-Binet formula 
in a form convenient for us. Let A{x, y) and B(y, z) be Z x Z matrices, and AB is 
their product (assume that it is well-defined). Then for any two ordered iV-tuplcs 
of integer indices x\ > . . . > xn and z\ > . . . > z/v, one has 

Aet[{AB){x llZk )t k=1 = det[A(x i)% )]5=idet[B( % ,^)]^ =1 , (4.1) 

yi>...>VN 

where the sum is taken over all ordered TV-tuples y\ > ... > yN- 

4.2. Inverse Vandermonde matrix. Here we discuss the inverse Vandermonde 
matrix — an object that turns out to be very useful in our argument. This matrix 
was also used to obtain the determinantal kernel in [Fj. 

Let a\ > ... > a^r be some points which we call nodes, and consider the Van- 
dermonde matrix V(a) := [af r_,7 ]i V 7= i- Clearly, 



detV(a) = V(ai,...,a N ) = JJ x 



<i<j<N 



(a, -a 3 ) ^ 0. 



Let V(a)- 1 be the inverse of the Vandermonde matrix. 

Proposition 4.1. The elements of the inverse Vandermonde matrix can be written 
as double contour integrals as follows: 

N 

r, r, n In 1 / , / d-W 1 -r-r W — d r . . 



(27ri) 



(oo) 



- 1 z — a r 



i/ere c(aj) is any small positively oriented contour around aj; the positively oriented 
contour c(oo) in w contains tiflj) (without intersecting it) and is sufficiently large. 

Proof. Using the elementary symmetric polynomials e m (j |3.2[ ), one can write 

yj-l e i-l( a lj • • ■ 7 a j + lj ■ ■ ■ ) a Af) 



[VCa)- 1 ]^ = (-l) i 



(4.2) 



Indeed, this formula follows from the fact that every cofactor of the Vandermonde 
matrix V(a) can be identified with the numerator in the right-hand side of (3.1) 
with v of the form (l m ) = (1, . . . , 1) (m ones) for some m (cf. (3.3)). 

(-l) t-1 ei_i(ai, . . . , aj-i,a j+1 , . 



Using (3.5), we have 
[V(a)- 1 ], 



, a N ) 



Ur*j( a 3 



1 

2?ri 



dw i r w — a r 



c(oo) 



— TT 



w N + 1 -* " a, 



(4.3) 



Then it is not hard to see that (4.3 ) is the same as the claim of the proposition. □ 

Products of the inverse Vandermonde matrix with certain column vectors are 
readily computed in a closed form: 
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Proposition 4.2 (Summation formula). Let f be any polynomial of degree not 
exceeding N — 1 . Then we have 

N 

ElVW^'M) = K _< ]/H. i = l,..-,N, 

3=1 

where [w N ~ z ](- ■ ■ ) means the coefficient by w N ~ l in f(w). In other words, 

2?ri 



,N-i 



(oo) 



N+l-i 



dw. 



Proof. Using ( |4.3[ ), we see that 

iV 



J = l ^ J<(oc) W j=1 ^. „j ~ r 

The sum over j under the integral is the Lagrange interpolation polynomial of 
degree N — 1 with iV nodes a\, . . . , a^. Since / is a polynomial of degree < N — 1, 
the interpolation is exact and the sum is simply equal to f(w). This concludes 
the proof. □ 

4.3. First determinantal formula. The goal of this subsect ion is to obtain a 
K x K determinantal formula for the quantity D ™^ n " ( -^'' y - ) as in (1.51 but first with 
a different (more complicated) kernel. Then in j ]4.4| we explain how to transform 
that formula into the desired claim of Theorem 11.21 



Proposition 4.3. For any 1 < K < N, x £ GT^, and v g GTjv, we have 



Dimjy v 



(N-l)\...(N-Ky.-det[Mx 3 -])}« 



where 

A i {x)=A i (x | K,N, v) 



1 



dz 



dw 



(27ri)' J € ( x ) j c(oo ) w 

(z-X + l) N -K-l 



N+l-i 



(4.4) 



(4.5) 



1 N 



w — v r + r 



(N-K-lY. w - z 11 z - u r + r 

\ / r—l 

Here the positively oriented contour €(x) in z encircles points x, x + 1, . . . , V\ — 1, 
and not x — 1, X — 2, ... , Vfq — N (this contour is the same as in Theorem \l . 2fy . The 
positively oriented contour c(oo) in w contains €(x) (without intersecting it) and is 
sufficiently large. 



The rest of this subsection is devoted to proving Proposition |4.3 
and v = 

= V(-1 



Step 1. Fix N and v = e GT N . Using we write 

1 



Dimjv v 



-N)-det [V(^i-1, 



v N - TV)- 1 ] 



N 



i,j=l 



where V(-) is the Vandermonde determinant (3.2), and we also use the inverse 
Vandermonde matrix (f 4.2 1 with nodes v\ — 1 > . . . > vpj — N. 
Define the following functions on Z (i = 1, . . . , N): 

N 

V>i(z \N)=i/)i(x\ N, N, v) := £ U= V] - 3 ■ [V(^ - 1, . . . , u N - iV)" 1 ]^-. (4.6) 

3=1 
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An obvious but useful observation is that for any integers y\ > . . . > y^, we have 



V(-l,...,-N)-det[MVj \N)]? tj= 



1 3/1=^1— 1 



■ • l?yj\r = 



VN = l>N-N 



(4.7) 



Dim jv v 

Step 2. Let us express the relative dimension through the skew Schur polynomial: 
DimRr,Ar(x, v) = s v/it {l, . . . , 1) (N - K ones, see pi). Using ( |3 .12j ) and | |3.22| , 
we rewrite this quantity as 



£ det[a(xf ,xf + 1 )]^ = \ ■ ..det[£i(xf-\xf )]ft =1 . 



(4.8) 



The sum is taken over all arrays of integers {x™}m=k+i °f depth N — K — 1; in 

j. The determinants ensure interlacing of the 



the notation of (|3.12|), x™ = i/ m ) 



rows x m as in (3.17), cf. (3.191 and (3.22 1. The Kth. and JVth rows are fixed, 



Xj — j, and the same for x and v. The matrix elements £i(-, •) are given in 
(3.21 1 (with u — 1). By agreement, we append every row of particles x}, . . . , x™ by 
the virtual particle x™ +1 



Dimjv v 



= V(-1, 



virt as explained in S]3 
our ra1 

-N) 



Step 3. Now we can write our ratio of dimensions as the following sum: 



E 

x K + 1 ,...,x N - 1 ,x» 



detK 1 (xf,xf+ 1 )]^ = 1 1 x 



(4.9) 



JV 



x detK 1 (xf+ 1 ,xf+ 2 )]^+ 2 1 ...det[e 1 (xf- 1 ,xf )]£ =1 det[^(xf | N)]» =1 . 

In the above sum, x K is still fixed as in Step 2, but now we can also sum over x 
because of (4.7 1. The sum in the above form is adapted to performing the Cauchy- 
Binet summation ([4.1), see Step 5. 

Step 4. Let us define convolutions in the usual way (e.g., see [Bit §4]): 

(/ * g)(x, z) ■= E f( x > y)9(v> z ); (9 * h)(x) := 9(x, y)h(y) 



MfcZ 



for any functions f(x,y), g(x,y), and h(x). 
Let for K < N, 



i>i{x I K) = rPi{x \ K,N,v) := (£i * | N)) (x). 



(4.10) 



N-K 



Lemma 4.4 (Vanishing property). For any K < N and x < — K — 1, one has 

hf I v m,A J ' ifi = l,...,K; 

vy 1 ' ' ; \l/(N-K-l)\, ifi = K + l. 

Moreover, ipi(virt \ K, N, v), i = 1, . . . , K + 1, is given by the same formula. 

Informally, one may think that ipi(virt \ K) = \in\ x _>_oo ipi(x \ K). 

Proof. First, observe that for x, y £ Z we have 



1 

2tti 



dz 



1 



(cf. (3.6) and (3.18)), so 



dz 



N=1 + 1 1 - z 
1 



)[ ,V) ~ 2m J lzl=1 zv-x+i (1 - z) N ' - 



1 



x<y 



N-K-l + y-x^ 
N-K -1 
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This implies that 

(N - K - 1)! • ^{x \K) = J2 ^ (y - x + l) N - K -i ■ My I N) 

= t-i>j-j>x ■ {"j - j - x + l)jV-A'-l[V(^i - 1, . . . ,i/jv - N) } 

(we have used ( |4.6[ )). 

Consider the following polynomial in w of degree N — K — 1 < N — 1: 

f(w) :=(w-x + l) N - K -i. 

It can be readily checked that for x < — K — 1, one has 

U 3 -j>x ■ f(vj ~ j) = f{vj - j), j = l,...,N, 

due to the fact that f(w) vanishes for w = x — 1, . . . ,x — N + K + 1. 

Thus, one can apply Proposition |4.2| to the above sum over N and obtain 



(N - K - 1)! • ipi(x | K) 



]/H- 



This is zero for i = 1, . . . , K, and is equal to one for i = K + 1. This establishes 
the "non- virtual" claim of the lemma. 

To prove the claim about ipi(virt | K), observe that ipi(y | K + 1) = for 
i = 1, . . . , K + 1 and all sufficiently small y £ Z (this follows from the "non- virtual" 
claim). Since we have (see (3.21)) 

ipi{virt | K) 



My I + 1) MKl *(* I = £ _ Afa I A' + 1). 

— <y: y>x 

we can add zero summands to the second sum over y, and conclude that ipi(virt \ 
K) = ipi(x | K) for i = 1, . . . , K + l and all sufficiently small x E Z. This completes 
the proof. □ 



Step 5. Let us perform the Cauchy-Binet summation (J4.ll in (4.9). We do the 
summation first over x^, then over x^ -1 , etc., up to x K+i . The first summation 
gives 



det[a(xf- 1 ,xf)]^ =1 det[V i (xf | N)]? j=1 = det^xf" 1 | JV - l)]ft =1 . 



Using Lemma 4.4 we see that the TVth column of the matrix [ipi (xr 1 | N — 1)] 



1JV 



,fe=i 

has zero entries except for the (N, N)-th element which is equal to 1 (recall that 
xjy -1 = virt). This allows to replace the N x N determinant in the right-hand side 
above by the same determinant of size N — 1. 

Continuing and summing over the row x m , m = N — 1, . . . , K + 1, with the help 
of Lemma |4.4| we will each time reduce the size of the determinant by one, and this 
will produce the factor 1/(N — to)!. Thus, we have shown that 

Diny^^) = {N _ iy {N K)[ detM -j\K, N , „)]* =1 (4.11) 
Dim 7v v 



because in ( |4.9[ ) we also had a factor V(-l, . . . , -N) = Oil! . ..(N — 1)!. 
Step 6. Let us now explain how to write the quantities ipi( x I K) entering the 
determinant in the right-hand side of (4.11) as double contour integrals. We have 
(see the proof of Lemma 4.4 ) 



1, 



-j>x ' 



1) 



N-K- 



(N-K - 1)1 



i[V(^-l,. 
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By Proposition 4.1 each (£, j)-th element [V(i/i — 1, . . . ,Un — N) ]y of the inverse 



Vandermonde matrix is written as a double contour integral; the z contour there 
is around Vj — j, and the w contour is any sufficiently large contour. Integrating 
over the z contour amounts to picking up the residue at z — Vj — j. Thus, the 
above sum over j such that Vj — j > x can be rewritten as an integral over the z 
contour encircling points x, x + 1, . . ., and not x — 1, x — 2, . . ., with the quantity 



(i/j— j— a;+l)jy_K-_i 
(N-K-l)\ 



replaced by 



( z-X+l) N - K -l 

(N-K-iy. ■ 



In this way we get the double contour integral formula (4.5) for the matrix 



elements in (4.11). This argument completes the proof of Proposition 4.3 



4.4. Linear transformation and proof of Theorem |1.2[ We now aim to rewrite 
the K x K determinantal formula obtained in Proposition |4.3| and get the desired 
formula of Theorem 11.21 



We claim that the K x K matrices in (4.4) and (1.5) are related by a rather 
simple row transformation. To see that, we perform the w integration in (4.5). 
Since we can choose our contours so that on them \w\ > \z\, we may expand 

1 



E 



j>0 



Then, since by (3.5), 
dw 



1 

27" J c (oo; 
we have 



N 



W 
1 

2?ri 



JV+l- 



tW 



- 1 Y[(w - v r + r) = (-l)^'- 1 ^-!^! -l,...,v N -N), 



dz 



(z-x + l) N - K -l 



<£(x 



} (N-K-l)\ 

i-l 



N 

n 



i 

Vr 



V . ^(-l^'-Vj-i^i -l,...,u N -N). 

* — '.7=0 



Now observe that the index i enters the expression for Ai(x) only through the 
following polynomial in z: 
-l 



' J l—l) 



-J- 1 , 



-i-i 



(px - 1, . . . , Vff - N), 



i=l,...,K. 



The polynomials pi are monic (i.e., with the leading term 1) and have degrees 
0, 1, . . . , K — 1. Thus, applying a suitable row transformation to the K x K matrix 
in (4.4), we may replace them with any other basis in the space ]R<^_ 1 [z] of poly- 
nomials in z of degree < K — 1, and this will affect only the constant factor in our 
K x K determinantal formula. 



The quantities Ai(x) in (|1.5|) have the form 

+ 1)n-k- 



Ai(x) 



1 

2ni 



dz 



<Z(x 



where 



(N-K-1)) 
(N-K)l(z + 1) N 



N 1 

^wn — 



V r + r 



1. 



,K. 



(z + i) N -K+i 

These polynomials all have degree K— 1, and they clearly form a basis in M<«r_i[^]. 
To establish ( |1.5[ ) , it remains to compute the determinant of the transition matrix 
from the basis {pi} to {pi}. 
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Lemma 4.5. For the matrix T — [Tyfj =1 such that ^f = iPi{z)Tij — Pj(z), we 
have 

detT = (N - 1)! . . . (N - K)\. 

Proof. Since the matrix of coefficients of the polynomials {pi(z)} is unitriangular, 
it suffices to show that the determinant of the matrix of coefficients of {pi(z)}fL 1 
has determinant (N — 1)1 . . . (N — K)\. That is, we need to show that 



det 



1 I Pi(z) 



27ri Jj 2|=1 Zj 



dz 



K 



= (N- 1 )! . . . (N - K)\. 

i,i=l 



It is not hard to see that the above determinant is equal to 

■ &et[pi(z,j)\^ =1 



Since the p^s form a basis in R<jf_i[z], the determinant det[pi(zj)]f-j =1 must (up 
to a constant) coincide with the Vandcrmonde determinant V(zi, . . . , Zk)- This 
constant does not depend on z\ , . . . , Zk and can be computed as 

detfo(zj)ff j=1 = det\pi(-j)]? j=1 = Pl (-l)... PK {-K) 
V[zi,...,zk) V{-l,...,-K) V(-l,...,-K) 
In the last equality we used the fact that Pi[—j) = if i > j. We also have 

so 

detbi(zX-=i = {-l) K(K - 1)/2 (N - 1)! ... (TV - K)\ ■ V(z u . . . , z K ). 
On the other hand, observe that 

1 f I dz x ... dz K 

|*i|=l \zk\=1 

= coefficient by z 2 (z 3 ) 2 . . . (z^ 1 in V(zi,...,Z K ) = (-l)^(^- 1 )/ 2 . 
This concludes the proof. □ 



With this lemma, Proposition 4.3 readily implies Theorem 1.2 



4.5. Comparison with |BQ2( Prop. 6.2]. In this subsection we prov e Pr oposition 



1.3 



That is, we compare our formula for D "° K dp^>}0 f Theorem 

1 ijim v 



1.2 



rith the 

formula obtained earlier by Borodin and Olshanski |BQ2( Prop. 6.2]. 

Let us recall the notation of [1302, Prop. 6.2]. Let L be a finite interval of 
integers. By Vl denote the space of rational functions in one variable z which are 
regular everywhere including z = oo, except that they may have simple poles at 
some points in Z \ L. This space is spanned [B02] Prop. 6.1] by the functions 

Every function / from Vl can be expressed as a finite linear combination of /L, m 's, 
the coefficients of this expansion are denoted by (/: fh.m)- 
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Recall the function H* (-\v) ( 1.4 1. As a rational function in z, for every v <G GUV 
it lies in VL(iv), where h(N) := {-N, . . . , -1}. To formulate [BQ2l Prop. 6.2], 
choose v € GTjv and >r € GT^, K < N. For j = 1, .... X, denote 

L(iV,i) : ! .V • A j 

The formula of [EU2I Prop. 6.2] looks as 

Dimjf,iv(x, i/) 



Dim 



det 



K 



(4.12) 



In the rest of this subsection we show that our quantities ( |1.6[ ) are equal to 

4(1) = ^ (a | i^,A» = {H*(;v): f HN , i)tX+i ) , (4.13) 

for any i = 1, . . . , K and ieZ. This will establish the equivalence of our formula 
(1.5) with (4.12) (and thus prove Proposition 1.3). 

Fix i = 1, . . . , K and expand H* (z; v) into a finite linear combination: 

H*(z; v) = X! peZ v ) '■ fh(N,i).x+p) ■ fh(N,i),x+ P ( z ) 

Let us apply the integration of the form g(z) i-> ^"f" /g^) ^(z+T/i^+i" 1 9^ z ^ z 
(see (1.6)) to the both sides of the above expansion. We see that to get (4.13), it 
suffices to show that 

N-K f (z-x + 1) N -k-i 



2m 



€(x) 



{z + i) 



N-K+l 



-fh(N,i),x+ P ( z )dz — Si^p. 



(4.14) 



It can be readily checked that the f's above have the form 

(z + i)n-k+i 



fh(N,i),x+p( z ) ~ 

Consider two cases: 
{i = p) We have in this case 

N-K f (z - x + 1)jv-K-i 



2vri 



t(x) (z + i)N-K+l 



(z + i-x-p) N - 



fl.(Na),x+i( z )dz 



A'+l 



-dz. 



N-K r i 

2?ri 7 £ ( x ) (z - x)(z - x + N - K) ' 

The only pole of the integrand inside €(x) is z = x, and the residue at this pole is 
equal to one. 
{i 7^ p) We have 

N-K f (z-x + l) N - K -i 



2ni 



C(x) 



(z + i) 



N-K+l 



~-fh(N,i),x+p( z )d z 



N-K 



(z-x + 1) N - 



K-l 



The zeroes of the numerator are 

and the zeroes of the denominator are 

z = x + p — i, x + p — i — 1, . . . ,x +p — i 



27ri J<t( x ) ( z + i~ x- p) N -K+l 
x-N + K + 1, 



-dz. 



N + K. 



Observe that the integrand decays as z 2 at z = oo and so has zero residue at 
infinity. Recall that the contour <£(#) encircles points x, x + 1, x + 2, It is 
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readily seen that (1) if p < i, then the integrand has no poles inside <£(x), (2) for 
p > i, all the poles are inside €(x). Thus, the integral vanishes in both cases. 

We thus have proven (4.14), and therefore established (4.13). This concludes the 
proof of Proposition [O 



5. Idea of proof of the Uniform Approximation Theorem 



As shown in §§7-8 of |BQ2| . the determinantal formula (4.12 ) for the relati ve di - 
ji mjt iW (x,i/) implies the Uniform Approximation Theorem (Theorem 2.9 ). 



mcnsions 



In this section for the sake of completeness we include an idea of proof of Theorem 



2.9 based on our equivalent formula for the relative dimensions (1.5|-(1.6|. Wc 



omit certain technical details which are the same as in [BQ21 §8]. 

Let us first rewrite the quantities Ai(x) (1.6) as contour integrals over the unit 
circle T: 

Proposition 5.1. For any fixed K , i and x, all N > K + x + 1 and any v € GTjv 
one has 



Ai(x) 



1 
2~7ri 



$(u;w(i/)) N 

l5=T + 



- x + \) n-K-1 N(N - K)u du 



21 N-K+l 



(u-lf 



(5.1) 



where ui(v) and $(u;w) are defined in {2.3 



This statement is parallel to |BQ2|, Prop. 8.1], but seems somewhat simpler 
because it does not involve several different cases. 



Proof. The quantity Ai(x) is given in (1.6) by the single contour integral over 
the positively oriented contour <£(x) which encircles points x,x + 1, . . and leaves 
outside x — 1, x — 2, . . .. However, observe that all possible poles of the integrand 



(z-x+ 1) N - K - 



(z + i)n-k+i 
belong to the set 

{vi - 1, . . . , P N 



(z - x + l) N _ K _ 1 (z + l) 



N 



(z + i) N - K +i fJr=i {z + r-v r ) 



N} \ {x - 1, x - 2, . . . , x - N + K + 1}. 



This readily implies that we can drag the contour <t{x) to the left, and replace it 
by <t(x — N + K + 1) without changing the integral. 

Note also that the integrand in (1.6) has zero residue at z — oo because there 
it decays as z~ 2 . Thus, one can deform the contour €(x — N + K + 1) so that it 
becomes the vertical line which crosses the real line to the left of x — N + K + 1: 

z(t) = x-N + K+l~it, -oo<t<co. (5.2) 

We now perform a change of variable suggested in |BQ1[ Prop. 5.2]: 

IN N , w s 

1 + r. (5.3) 



2 u-1' 
As shown in that proposition, we have 

H*(z;i/) = $(u; 



z + 
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. , Nu du , 
Clearly, dz = — - — ^ — . Ihus, we obtain 

(u — ly u 



Ai(x) 



1 

2?ri 



(t^i- x + Dn-k-i N(N - K)u du 



£'(x-N+K+l) 



N 



+ i 



2) N-K+l 



(u-iy 



u 

(5.4) 



which is almost the same as the desired claim (5.1 1, except for the minus sign and 
the fact that the integral is over the contour €!(x — N + K + 1) which is the image 
of (5.2 1 under our change of variables (5.3). That is, the contour in (5.4) is 

N 



u(t) 

Take N > x + K + 
circle with center 1 ■+ 
(clockwise) direction. 



1 



-co < t < oo. 



x-N + K+l-it' (5 - 5) 
1. An elementary computation shows that this contour is a 
- 2(x-n+k+i) an d ra dius 2 \x-N+K+i\ P asse d in the negative 



The integrand in (5.4) has a finite number of possible poles which arise from 
jecially Di 

G (l,co); 



$>(u;u)(i>)) (see {2.3 and especially Definition 2.3) 
1 



1 



1 



1 



1 + at {y) 



e(-i,l) 



plus a pole at u = 1 (corresponding to z = co via (5.3)) where the integrand has 
zero residue. Because N > x + K + 1, the u contour (5.5 1 encircles all poles which 
are inside the unit circle and leaves outside the ones belonging to (l,oo). Thus, we 
can replace it by the unit circle T itself. The negative direction of the contour (5.5) 
then eliminates the minus sign in (5.4). This concludes the proof. □ 



It can be readily checked that in ( |5.1[ ) we have 
,(N) ,. A ._ (d=l- x+\) N -k-i N{N-K)u 



1 



' N 
. u—X 



(u-iy 



,x+% ■ 



N 



CO, 



(5.6) 



2) N-K+l 

uniformly in u G T for fixed K, x, and i. Thus, every Ai(x) has a nice asymptotic 



behavior. Namely, it is close to (fi +x {uj{v)) (see (2.5) and Definition |2.3| . 

The rest of th e proof of Theorem |2.9| is based on Pro position |5.1| and on the a bove 
observation (5.6). We need to show that A^(i/, x) (1.3) is close to A^(uj(v),x) (2.7) 
for all fixed K and x € GTk, all large N and any v € GUV- Both links involve 
one and the same factor Dim^ x, so we need to show that the following K x K 
determinants 

Dini^ TV ^) r a / \iK / / \\ r / / 

— . — = detlAifa - j)k, j=1 and <p x (w{v)) = det[^._ J+i (w(i/))] ij=1 . 

YJ llll j\j is 

are close to each other. Both these determinants admit similar i^-fold contour 
integral representations with integration over the torus T K := T x . . . x T: 

1 



det[Ai(*j ~ i)]5=i = 



(27Ti)^ 



det[K 



(AT) , A]K dux 



duK 
U K ' 



det[^_ i+i (w(i/))]5 =1 = £ k w(f)) . . . $(u K ] 
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K 



du\ dux 



«1 



j uniformly 



Since (5.6) implies that det^^.^. z (u)}^ =1 det[u-^-i+ 1 ^ 
in , . . . , uk ) € T , this implies the desired Uniform Approximation Theorem 
(Theorem 2.9), and thus (as explained in B02, §3]) the description of the boundary 



of the Gclfand-Tsctlin graph. 

6. ^-GENERALIZATIONS 

In this section we briefly discuss g-extensions of Theorem|1.2| We start with the 



most general statement, and then obtain Theorem 1.5 as its corollary. We will also 



discuss in §f 6.5 6.7 some connections of Theorem 1.5 with the g-Gelfand-Tsetlin 
graph and g-Toeplitz matrices of [G] . 
We will always assume that < q < 1. 

6.1. (/-specializations of skew Schur polynomials. In the language of Laurent- 
Schur polynomials, Theorem |1.2| provides a K x K determinantal formula for 

N-K 



Dim g;A r(>ir, v) _ s u/>c (l, . . . , 1) 



Dim 



N V 



N 



Our g-generalization involves putting powers of q instead of l's in the numer- 
ator and in the denominator of the above formula. The ordinary (not skew) 
Laurent-Schur polynomial s„ will always be evaluated at the geometric sequence 
l,q, . . . , q , Using our approach with the inverse Vandermonde matrix, we man- 
age to replace the N — K ones in s u /^(l, . . . , 1) by any subset of the geometric 
sequence l,q,... , g^ -1 , and there still exists some K x K determinantal formula 
for the quotient of (/-specialized s v j^ and s v . 

Let us introduce some notation. Let F := {0, 1, . . . , N — 1}, and T — {t\ < <2 < 
. . . < f TV— C F be any subset of size N — K. Define the following functions: 

JV 



(6.1) 



q tf (x) = q tf{x | K, N, v) := £ h Vj - 3 - x {q T ) ■ [V(g* 

i=i 

(i = 1, . . . , N, x E Z), where h m (q T ) is the complete homogeneous symmetric 
polynomial ( p^ evaluated at q H ,..., q tN ~ K , and V(q UN ~ N , . . . , g" 1-1 ) -1 is the 
inverse Vandermonde matrix ([4.2) with nodes q VN ~ N > . . . > q" 1 ^ 1 . 



Let S := F \ T , and S' := N — S (the operation is done with every element). 
Write S' in increasing order, S' — {s' x < . . . < s' K }. 

Theorem 6.1. With the above notation, we have the following K x K determinantal 
formula for any 1 < K < N , k 6 GTk, v € GT^, and any subset T C F of size 
N - A'Q 



s v {l,q,q 2 



,Af-l 



(6.2) 



(-q N ) tl+ --- +fN - K ■ V ^ q 1,g 2 ' 



V(q* 



jt-N-K ^ 



det[,i/#(*3 -j)] 



Note that the right-hand side of (6.2 I is clearly symmetric in ti, ,t 



as it should be. 
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where V(-) is the Vandermonde determinant \3. 

Remark 6.2. One can define a measure on Gelfand-Tsetlin schemes with fixed 
top row v £ GTn whose projections to every Kth level, K < N, have the form 

s v/ M tl ,---,q tN - K ) 



s H {<f\...,q s «) 



,JV-n ' 



k £ GT 



A' 



(6.3) 



, N — K — 1} we get the measure q P 



N,v 



(cf. identity ( |3Tl3[ )). For T = {0,1,. 
(i.e., q m] ), see £1.5 and £6.3 below. 

Projections (6.3 1 allow to define more general g-deformations of the Gelfand- 
Tsetlin graph than the one considered below in § §6.5||6l3l We plan to discuss their 
boundaries (defined in the spirit of Question 6.4) in a subsequent publication. 



The rest of this subsection is devoted to proving Theorem 6.f 
We argue as in |4.3| Consider the functions 



^f{x) = q ^f{x\N,N,v) 



E 



JV 

3=1 



vpt—N 



(which are particular cases of ( 6. 1| ) ) . For any integers y\ > 
obvious identity parallel to (4.7) (see also ( 3.f 

1, 



■,q Vl - x )- x ]i3 

> j/jv there is an 



V(q-\. 



,q 



-N\ 



det[ q tf( yj \N,N,v)] 



N 



L yi=v 1 -1 



1 



Vn=v n -N 



Next, using (3.12) and (3.22), we can write the skew Schur polynomial similarly to 
(4.8), which leads to the following expression (cf. (4.9)): 



s v (l,q,q 2 ,. 

x E 



-,N 



(6.4) 



x det[£ g t 2 (x 



A+l „A+2\iA+2 



3=1 ■ ■ 



det[^ N -.(xf- i ,x;)]^. =1 det[^f(xj v )]C i= 



This formula is adapted to performing the Cauchy-Binet summation ( g4.1[ ) as in 
Step 5 in £4.3 but first we need to obtain an analogue of the vanishing property 
(Lemma 4.4): 

Lemma 6.3 (q- vanishing property). For any subset J = {ji, . . . , ji} C F , t < N, 

any i = 1, . . . , N, and any x < z/jv — N + £ — I we have 

'o, ifN-i(£J, 
q -x(N-i) ft (1 - q r - N +T\ otherwise. 



Moreover, 



jtpfivirt) 




(1-5 



r-N+i\—l 



Informally, one may think that gipf (virt) — lim x _ 



ifN-ii J, 
otherwise. 



Proof. First, observe that h m (q J ), where m = 0, 1, . . ., can be viewed as a poly- 
nomial in q m . Indeed, by the very definition of the Schur polynomial (3.1), we 
have 

/WU#r(fn-l«=i 
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Expanding the determinant along the first column, we obtain 



h m {q 



n 



• q 



■?o 



£' fe=1 (-i) fe -VTV^- 1)l ^ 



fjk-l f]3k+l 



,q h ) 



,q n ) 



1L , '/";' 

This gives an explicit expression of h m (q J ) as a polynomial f(q m ), where 
detK''' 1 ^ 1 ^"^ s =i v- 



V(q^,...,q^) ^k=i J-J-r^fc' 

Clearly, dcg/ = max{ j : j G J} which is < N — 1, and this polynomial contains 
only powers w J1 ,...,w Jk . Moreover, from the expression of f(w) as a ratio of 
determinants it follows that 

f(q- 1 ) = --. = f(q- {e - 1) )=0, 

because for these values of w the determinant has two identical columns. 
Therefore, for any x <v^ — N + £ — lby Proposition |4.2| we get 

q ^{ x ) = Y? =l f(q u '- j - x ) ■ [y(q UN - N , q vx - l )-% = [^l/N" 1 ). 



Jk 



Thus, if TV 



J, this is zero, and otherwise we have 



(1-5 



r-iV+i 



It is not hard to check (similarly to the end of the proof of Lemma 4.4) that 
q ip((virt) 
the proof. 



q tpf (virt) is given by the limit of the above expression as x 



oo. This concludes 
□ 



Us ing L emma 6.3 we perform the Cauchy-Binet summation (similarly to Step 
5 in ? 4.3 1 in (6.4) first over x N , then over x^" 1 , etc., up to x K+1 . Every such 
summation reduces the size of the determinant by one. For example, in the first 
summation we have 



V" i . r, ,.,.\- I „.V ,- V .]..,.[ ... ,„.\ ,|.\ .,i«N-Jf}^ x W-ljjW i 



det[^ N „ K (xf"\xf det^f (xf )]& =1 



det^f* 



The ATth column of the matrix in the right-hand side (corresponding to x w 



A' 



virt) has zero entries except for the (N — i/y_fc)th one which is equal to one by 
Lemma 6.3 The same reduction happens after every summation, and each time 
we use Lemma |6.3| It is not hard to see that the resulting factor which arises 



after these reductions, combined with what was alread y pr esent in (|6.4|), gives the 



desired prefactor (-q , y jn-W ) 

Thus, we have established Theorem |6.1[ 



in (6.2) 



6.2. Remark: contour integral representation in Theorem 6.1 Using Propo- 
sition 4.1 and the proof of Lemma 6.3 one can suggest the following double contour 



integral representation for the functions q ipJ \x \ K,N,v) (6.1) entering Theorem 
1631 

q ig{x\K,N,v) 



(2m) 



dz 

€{x) J c{oo) w 



dw 



N+l-i 



N-K 



If 



to - q v -- r 
z - q u r-r 



z tk q- xtk 
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The contour q £{x) is the same as in Theorem 1.5 and c(oo) is any sufficiently big 
contour containing q €(x). 

We see that a q = 1 statement parallel to Theorem |6.1| is Proposition |4.3| and 



not Theorem 1.2 In the general setting of Theorem 6.1 it is not clear whether it is 



possible to perform a linear transformation of rows in the K x K matrix in (6.2) 



so that the new matrix elements would have simpler form (e.g., as it was done for 

■ ,q 



1 in {4.4). In the rest of this section we restrict our attention to the special 

tN-K [ n (6.2) is a geometric sequence. This 



case when the ^-specialization q l1 , . 
allows to perform the same trick as in [4.4 and obtain Theorem 1.5 in which the 
matrix elements admit a single contour integral representation. We discuss this in 
the next subsection. 



6.3. Proof of Theorem 1.5 Define the ^-analogue of the number of trapezoidal 
Gelfand-Tsetlin schemes of depth TV — K + 1 with top row v £ GUV and bottom 
row x € GTjc, K < N, by 



r (x,„) := q ^ N - K h v/ M,Q,---,Q N - K - 1 ), 



(6.5) 



where s^/^ is the skew Schur polynomial (£3.5). By (3.12), one may say that 
q T)imK,N(x, v) is the partition function of trapezoidal Gelfand-Tsetlin schemes 

where the weight of every particular scheme is proportional to 



q \*\ q w {K+1 ' > \+w lK+2) \+-+w lN - 1} \. 



The factor q\*\ (which does not depend on a particular trape zoid al Gelfand-Tsetlin 



scheme) is introduced so that the g-link g A^ (defined in [1.5 as a projection of 



the (/-measure (1.8)) is given by formula (1.9) which is similar to the corresponding 
q = 1 formula ( 1.3 I. 



In terms of Schur polynomials, Theorem 1.5 gives a Kx K determinantal formula 



for 



gDim^jy(x, v) _ (jv-jqi^i s u / x {l,g.. 
,Dimjv^ ' s u (l,q,q 2 , 



^N-K-l 



q xvxiiijv " °v\^)H>H !•••><? 1 ) 

In order to prove it, first observe that a particular case of Theorem |6.1| for T 
{0,1,...,N- K - 1} gives 



(6.6) 



,q 



N-K-l 



= (_ n N ) (N-K)(N-K~l)/2, 



s v {l,q,q\...,q^) 



(6.7) 



V(q~ 



--N\ 



V(l,q,...,q 



N-K-l\ 



det[^f(^-j)]5 =1 . 



We have for m > 0: 



h m (l,q, 



Jf-K-1\ 



(q m + 1 ;q) N - K - 1 

{q;q) 



N-K-l 



(this is a particular case of (3.11), cf. (3.4)). This implies that one c an w rite the 



functions q ipf(x) for our T as double contour integrals as follows (cf. [6.2) 



(2m) 2 



dz 



dw (zq 1 x ;q) N -K-i 1 tt^ w - q Vr 



x) L(oo) wN+1 1 {q;q)N-K-i w-z 



IT- 
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Here the contour q £(x) is as in Theorem 1.5 it encircles q x , q x+1 , ■ ■ . , q Vl , and not 



q x \q x 2 , 



,q 



vn-N . 



and c(oo) is any sufficiently big contour containing q €(x). 



Performing the integration over w in the double contour integral above similarly 
to 94.41 we obtain 



1 
2tti 



1 XX r =l 



1 



N—K— 



z - q"r-' 



^i-i 



)• 



We again observe that the index i enters g tpf(x) only through the polynomials 



' — '3=0 



• q 



1, 



The polynomial q pi(z) is monic of degree i — 1 (i = 1, ...,K), and thus these 
polynomials form a basis in R<#_i[.z]. Applying a suitable row transformation to 



the K x K matrix in (|6.7|), we may replace this basis with another basis: 

i = l,...,K. 



qPi(z) := (g; g)iv-g N _ K+i 



Clearly, q A { {x \ K, N, v) is given by 



q Ai(x) 



2vri 



{zq 1 x ;q) N _ K _ 



<£{x 



) " (q;q)N-K- 



The linear transformation that replaces { q pi}fLi by {gPi}fLi will affect only 
the constant factor in (6.7). Similarly to Lemma |4.5l it can be shown that the 



determinant of the corresponding transition matrix is equal to 

! a -i ■■■(q;q)n-k- 



(_ 1 -jK(K-l)/2 q K(K-l)(K-3N-2)/6( q . q -j } 



Multiplying this coefficient by the factor a lrea dy pr esen t in ( |6.7[ ), and also by 
q(N-K)\>c\ b ecause of the difference between |6.6[ ) and (6.7), after necessary simpli- 
fications we complete the proof of Theorem |1.5| 



6.4. Limit as g / 1 (proof of Proposition 1.6). Fix integers K < N and a 
signature v £ GTTV- Write the quantities q Ai(x \ K,N,v) ( |1.11[ ) as sums of the 
corresponding residues: 



N—K\ (q Vl - j + 1 - X ;q)N-K-l Ur=l(l^ - I-") 

1I;V"<7" ' '/ <ill,, ; ;<r ' '/" •' ' 



1 A i (x)= ]T (!-' 



The g / 1 limit of every residue is readily computed, and we immediately see that 



lim,Ai(a: | K,N,u) = (-l)"- K A l (x \ K,N, v), 

q/-\ 



where Ai(x \ K,N,v) is dehned by (1.6). This concludes the proof of Proposi- 
tion [L6l 
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6.5. g-Gelfand Tsetlin graph. In this and the next subsection we aim to explain 
how our formula of Theorem [13] is related to the boundary of the q- Gelfand-Tsetlin 
graph. 

The q-Gelfand-Tsetlin graph q GT [GJ is a branching graph which has the same 



vertices and edges as the "classical" Gelfand-Tsetlin graph described in {1.2 (i.e., 
vertices are all signatures GT = |_l^= CJIV, and an edge connects signatures \x 
and A if n -< A). The difference is that instead of being simple (i.e., with multiplic- 
ity 1), the edges of the g-Gelfand-Tsetlin graph carry certain formal multiplicities 
depending on q. Namely, if fi -< A, then we assign the multiplicity q'^ 1 ' to the edge 
from (i to A. Every increasing path in the graph of the form v^ K > -<...-< i/W 
then is also assigned a multiplicity which is defined as the product of multiplicities 
of the edges along this path. 



It is not hard to see that the q-dimension q Dirri/v v (3.11), is equal to the sum 



of multiplicities of all paths from the initial vertex £ GTq to v £ G1V- The 



quantities q T)'m\K,N{x, v) ( 6.5 ) can be interpreted in the same way if one considers 
paths from yc to v (cf. j |l-2| ). 

6.6. Boundary of the q-Gelfand Tsetlin graph. The question about the bound- 
ary of the q- Gelfand-Tsetlin graph can be asked in the same way as in §2.1| using the 
notion of coherent systems on the floors GTn of the graph g GT. In the < q < 1 
case, members {Mjv} of a coherent system (where Mn is a probabili ty m easure on 
GT^r, TV = 0,1,2,...) must be compatible with the q- links q A^_ } 
to Definition 12. II In detail, it must be 



V M N {v) g H q D " njv ~ 1 P = Mjy-xOu), ViVandV/xeGTjv-L (6.8) 
c ™ , q iJinijv v 

The boundary d( q GT), i.e., the set of all extreme coherent systems on q GT 



(cf. Definition 2.2 ), was identified in [GJ with the set of all non-decreasing sequences 
of integers 

Af:={m < n 2 <n 3 < ...} C Z°°. (6.9) 

It is informative to note the difference of this set with the boundary ft of the classical 
Gelfand-Tsetlin graph (j ]2.3[ ). See also [Gj end of §1.3] for a brief discussion of 
what happens with the boundary (more precisely, with coherent systems on 9 GT) 
as q /*- 1. 

The problem of describing 9( g GT) reduces (in the same way as explained in 
f 2.2 1 to the following question (parallel to Question |1.1[ ) about asymptotics of the 



q- links: 

Question 6.4. Describe all possible sequences of signatures f(2), . . ., where 
v(N) £ GTw, such that for every fixed level K and signature >c £ G1V, the se- 
quence { 9 A^(j/(iV), x)}n>\ has a limit as N goes to infinity. We call such sequences 
{v(N)} q-regular. 

The result of [G] states that g-regular sequences of signatures {v(N)} are pre- 
cisely those whose last coordinates stabilize, i.e., 

lim = nj, i = 1,2,..., (6.10) 

where n = {ni < n-i < . . .} is the corresponding element of the boundary M = 



d( q GT). Note that this also differs from the q = 1 situation (see Remark 2.5| 
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Since Theorem |1.5| provides a new determinantal formula for the g-links, one 
could in principle use it to obtain the description of the boundary of q GT in a new 
way similarly to what was done for the classical Gelfand-Tsetlin graph in |BQ2] 



see also {2.6 and g5| We do not carry out this idea in full detail, we only check 



that for g-regular sequences (6.10) the g-links given by Theorem 1.5 have a limit, 
and, moreover, compute it. 

Proposition 6.5. Let {v(N}, is(N) € CJTjv, be a q-regular sequence of signatures 
in the sense of | 6.10) corresponding to n — {n\ < ri2 < . . .} £ Af. Then 

q Dim K , N (x, p(N)) K 

for any fixed K and x £ QTk , where 

A( \ir \ qX+K I (z ^+A-+i ;g)oo(z;g)K _ 

q Ai[x \K, oo, n) := — — f -, , — s dz. (6.12) 

2tti J q €(-x-K) (z;q | n)oo 

Here we use the notatioi^\ 

(t;qU :=n°°„( 1 - t ? r )' ^qlnU^jf (l-tq r+n ^), neAf - 

Proof. We start by investigating the behavior of the matrix elements of 



det^Mtj - 3 I K,N,v{N)Y K 



(see Theorem 1.5 1. We will assume that K = 1,2,..., i = 1, . . . , K, and x € Z 
are fixed. Observe that the contour q £(x) in the definition of q Ai(x \ K, N, v(N)) 
( |1.11[ ) can be replaced by q €{x — N + K + 1) because of the zeroes of the integrand 
z — q x ~ 1 ,q x ~ 2 , . . . , q x - N + K + 1 coming from the factor (zq 1 ~ x ; q)N-K-i in the nu- 
merator. Let us then change the variable to w, z = wq x ~ N+K+1 , so the w contour 
is simply g £(0) which encircles the segment [0, 1] and not the points g -1 , q~ 2 , . . .. 
We thus have 

(-1 _ n N-K\ x-N+K+l 

q A i {x\K,N,v{N))= K - q - x (6.13) 

Z7T1 

f (wq- N + K + 2 ;q) N ^ 1 , \ wq x -^+'<+^ - q ~r 

X lm W U^ K+i (m*- N+K+1 q- r ) L\ VQ X - N+K+1 - q»^- r ' 
Let us transform the factors in the integrand in ( |6.13[ ) one by one: 
1. We have 

(^™ 2 ;g) Ar -K- 1 ^^-^ 1 (-l) JV -^ 1 ^(^^ 1 )(^ 1 ; g ) M -i, 



and the factor (w , q)N-K-i tends to (w~ , q)oo as N — > oo and K is fixed. 
The two products of {wq x ~ N+K+1 — q~ r ) in the numerator and in the denomi- 
nator almost cancel out yielding K — 1 factors: 

if\^~ N+K+1 -<r p )iT N K+ - + S w ^ N+K+1 -^ r ) 

J- J-r— 1 A r— N — K 



\- r= N~K+i+l 
ri-1 , , , , »r ~t-rK-% 



= e -iV(K-l)TT ( W q x + K+1 -q- r + N )Y\ (wq x+K+1 - q 



r-l\ 



^The original proof of [G] is similar to the approach of |OQ] and is based on a Binomial Formula 
for certain q-analogues of Schur polynomials. 
9 Clearly, (t;q\ (0, 0, . . .)) x = (t; q)^ . 
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We have the following convergence as N — > oo 

,-X+K+l 



n" (^ +A " +i -^ +Ar )n ~w 

J-J-r— 1 J- j_ r — 1 



n;:;(^ +i )n;:;( 



r-l\ 



-q r - L ) 



^ q (K^)(x+K+l) {w -l q - x -K-l. q)K _ 



Finally, let us write 

rN 1 



n„, 



wq 



x-N+K+l 



■ju(N) r -r 



It, 



1 



= w- N q- N ^- N + 



wq 

N 



x-N+K+l 



K+l) TT v _ 

l-l-r=l 1 



„w(JV) N+1 _,.-JV-H-r 
1 



— w~ 1 q~ x ~ K ~ 2 q u ^ N + 1 - 



■+r 



Due to our assumption (6.10), we have as N 

rN 1 



TT 

i-J-r=l 1 



1 

(w~ 1 q~ x ~ K ~ 1 ; q \ n) 



Collecting all the above transformations, we see that the integrand in (6.13) 
behaves as N — > oo in the following way: 

-2 q) 00 (w- 1 q- x - K - 1 ; q) K -i „ 



(w 1 q 



-x-K-l 



;q I n)oo 

-l q -l+Kx+K(K~l)/2 q N(l/2-K-x)qN 2 /2 



(6.14) 



x (-i') N - K - 1 q- 1 -+ nx + n t. n - 1 -)/'< ! q n (W^-K-x) q "-/^^ (6.15) 

Without the prefactor ( 6.15[ ), the convergence as N — »• oo of the integrand is 
uniform on our contour 9 £(0). Let us take this prefactor (which depends only on 
the column of the matrix) outside det[ q Ai(xj — j \ K, N, v(N))]fj =i . Together with 
what was already present in (1.10), this yields a factor of (— q~ 1 ) K in front of the 
K x K determinant. Inserting (— q~ 1 ) K back into the determinant, we see that the 



desired convergence (6.11) holds with 



q Ai(x | K, oo, n) 



2m 



(w 1 ;q) 00 (w V 



x-K-l. 



q)K-i dw 



,C(0) 



(w 1 q x K l ;q\ n)^ w 2 



A change of variables u — 1/ w gives 



jAi(x | K,oo,n) 



q 

2m 



(M;g)oo(Mg x K 1 ;g) K - 

-x-K-X. 



-du. 



l q <£{!) (uq x K 1 ;q\ n)^ 

Indeed, the w contour g £(0) encircles a segment of the form [— e, 1 + e], so the 
u contour contains the possible poles q,q 2 ,. .., and only them, and thus can be 
replaced by g £(l). Another change of variables, z — uq~ x ~ K ~ 1 , concludes the 
proof. □ 

6.7. g- Toeplitz matrices. In the "classical" (q — 1) picture, for regular sequences 
of signatures {v(N)} (see Question |1.1[ ), the N — > oo limit of Ai(x \ K,N,v(N)) 
(1.6 ) for fixed K, i, and x is equal to ip i+x (uj), where lo is the point of the boundary 



<9(GT) corresponding to {v(N)} (see j |2.3| and Sj5j). In other words, the limit of 
Ai(—x | K, N,v(N)) viewed as a matrix with indices i and x, is a Toeplitz matrix. 
Moreover, this limiting Toeplitz matrix is totally nonnegative (see {2.5 for more 
discussion). 

As was noted by Vadim Gorin (private communication), in the < q < 1 case 
the limiting quantities q Ai(x \ K,oo,n) (6.12) should satisfy some version of the 
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q-Toeplitz property introduced in [Gj. The integral formula (6.12| allows to observe 
such a property directly: 

Proposition 6.6. For any boundary point n £ Af — d( q GT), all fixed K = 1, 2, . . 
i = 1, . . . , K , and x £ Z, one has 

q Ai-l{x) ■ q l = q Ai(x - 1) ■ q X - x + q Ai(x) ■ (q l - q~ x ), (6.16) 

where we abbreviate q Aj(y) = q Aj(y \ K,oo,n). 



Note that for 5 = 1, (6.16) is reduced to q Ai_\(x) = q Ai(x — 1), which agrees 
with the usual Toeplitz property in the q /* 1 limit (cf. j |6.4| . 

Proof. Due to the zeroes of the integrand, for q Ai(x— 1) the contour q £(—x+l — K) 
in (6.121 can be replaced by q €.(—x — K). In this way, all the three terms in (6.16) 
are expressed as integrals over the same contour. Then it is readily checked that 
the desired three-term relation is satisfied by the corresponding integrands. □ 



To rewrite relation (6.16) exactly in the form of the q- Toeplitz property [G, (5)], 
introduce new quantities 

B n (x, i) := q A K+l -i{x - K - 1 | K, oo.n) • q U—)(-+S). ( 6 .17) 



It readily follows from (6.12) that B n (x,i) does not depend on K: 

B"(z,i) = - — w-. i ; q)oo }: q)l - l dz. (6.i8) 

2ti-i J q €(-x+i) {z\q\n) 00 

For these B n, s it can be checked that 

B n (x, i + = B n {x-l,i) + (q 1 - 1 - q 1 - x )B n (x, i), (6.19) 

which coincides with [G] (5)]. 

The singe contour integral formula for B n (x, i) allows to observe one more prop- 
erty of these quantities: 



Proposition 6.7. We have for m > o{3 



e=o i=o JO ° 

The right-hand side is an entire function in z (by the Weierstrass factorization 
theorem), and the series converges everywhere in C. 

This proposition follows from a more general lemma: 

Lemma 6.8. Let <f>{z) be an entire function, and consider the expansion 

oo e-i 

W = 

1=0 t=0 

The coefficients of this expansion admit the following integral representation: 



*)=x>n(?~<-*). 



a i(e+i)/2 f it \ 

Cl = q ——i j^^dz, £ = 0,1,2, 



10. 



This assumption is not very restrictive, see \G\ Thm. 1.1.3]. 
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Remark 6.9. Lcmma [6.8| may be viewed as an inversion formula for some g-Laplace 
transform. A similar statement appears in |BC[ Prop. 3.1.1] with references to q- 
versions of the Laplace transform in [H] and in a recent manuscript Ban . To make 
our argument self-contained, let us present a proof of this statement. 



Proof of Lemma \6. 

<t>(z) _ cjq 



Fix j > and consider 

-j(j-i)/2 



1 — zq> 



X>«r^- 1)/2 

£=0 



+ an entire function. 



Integrating this equality over the contour j) which encircles only the possible 



poles q , q 



-j+i 



we see that the contribution from the sum over I vanishes 



because every term of this sum has no residue outside j) (it behaves as const ■ 



1 at infinity). The holomorphic part also vanishes, so we have 



1 
2tti 



<£(-j) 



(z;q) 



-dz = 



1 

2tti 



c 3 q 



<£(-i) 



1 - zqi 



-dz. 



Computing the integral in the right-hand side, we conclude the proof. 
Proof of Proposition \6. 

(zq i+1 ;q) c 



□ 



From (6.18) we have 



B 



1,1 



2-?ri J q £(-i) (z;q I n) c 



-dz. 



It remains to note that (zq + ; q) 



and use Lemma 



6.8 



□ 



{z;q)t+i 

Thus, we are led to the following statement: 

Proposition 6.10. For a q-regular sequence {i/(JV)} corresponding to a boundary 
point n G j\f = d(q&T) with ri\ > 0, i/ie Zimit of the q-links is given by 

lim q A%(u(N),x) =Dim K x-q-( K - 1 WqZ?=^-"r (*r+i)/2) x ( 6 . 2 1) 

xdet[S n (x K+1 _,;+i,j)]5 =1 , 

where B n (i,j), i,j > 1, is a unique q-Toeplitz matrix (in the sense of (6.19 )) whose 
first column satisfies (6.20). 



Proof. This a combination of (1.9), Propositions 6.5 and 6.7 and the fact that a 
q-Toeplitz matrix is completely determined by its first column via (6.19). In the 
right-hand side of (6.21) we have also rewritten the determinant &et[ q Ai{xj — j \ 
K, oo, n)]fj- =1 in terms of the g-Toeplitz elements B n (i,j). 



□ 



Remark 6.11. 1. The limit lim 



JV- 



A£(i/(A0,>f) in the left-hand side of (6.21) 



is in fact (see the discussion of f 2.2 which is also applicable in the < q < 1 case) 



equal to the value of the extreme coherent system corresponding to n G M at the 
signature x e GTk- This quantity is denoted by ( x ) m E2- 

2. Proposition 6.10 can be deduced from the results of [U] in the following way. 



Under the assumption n\ > 0, in [Gl Thm. 1.1.2] a certain generating function for 
the quantities (^)}>«eGT K is written out explicitly as a AT-fold product j^] This 
fact (together with some formulas from [G] proofs of Prop. 1.4 (§7) and Lemma 6.5 
(§6.2)]) allows to write the identity (6.21). The elements of the g-Toeplitz matrix 
there are defined in the same way as in Proposition 6.10 (e.g., see [Gj Thm. 7.1]). 



This development is parallel to the 9=1 considerations explained in { 2.5 
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This implies that the minors of the g-Toeplitz matrix B n (i,j), i,j > 1, that 
enter the right-hand side of ( |6.21 1 for various K and >r G <GTx are nonnegative. 



However, the matrix B n (i,j) itself is not totally nonnegative. See [G] §1.5] for 
more discussion. 

In addition to reproving some results of [G] , using our contour integral formulas 
we are able to readily obtain a solution of the g-Toeplitz recurrence relation 

d(x,i + l) =d(x-l,i) + (q 1 - t -q^^dix^i), x,i = l,2,... (6.22) 

(with agreement that d(x, i) = if either x or i is < 0) with initial condition 

d(t+l,l)=c e , £ = 0,1,.... (6.23) 

Proposition 6.12. Let the series 



(*) = X>n(? _i -*) 



e=o i=o 



converge everywhere in C. Then the solution of (6.22)-(6.23) is given for x,i > 1 
by the following contour integral: 

g|(x-i+i)(x+i-2) j (z;q) i _ 1 
d(x,i) = — * <t>{z)-r — ^dz. 
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